EuropSisches Patentamt 
( 19 ) (ml European Patent Office 

Office europeen des brevets 



iiiiiuiiiiiiiiiiiiMiiiiiiiiwiiiiiii 



EP 0 932 108 A2 



EUROPEAN PATENT APPLICATION 



(43) Date of publication: 


(51) Int. CI. 6 : G06F 17/24 


28.07.1999 Bulletin 1999/30 


(21) Application number: 99300387.0 




(22) Date of filing: 20.01 .1 999 




(84) Designated Contracting States: 


• oiiiey, uienn u. 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


Mountain View, California 94043 (US) 


MCNLPTSE 


• Herasimchuk, Andrei M. 




Palo Alto, California 94303 (US) 


AL LT LV MK RO SI 


• Rimmi, Katja 




Half Moon Bay, California 94019 (US) 


(30) Priority: 22.01.1998 US 10801 


• Pappas, Robert J. 


(71) Applicant: 


Apple Valley, Minnesota 55124 (US) 


• Scouten, Eric A. 


Adobe Systems Incorporated 


St.Paul, Minnesota 55105 (US) 


San Jose, California 95110-2704 (US) 




(72) Inventors: 


(74) Representative: 


Wombwell, Francis et al 


• Hamburg, Mark 


Potts, Kerr & Co. 


Scotts Valley, California 95066 (US) 


15, Hamilton Square 




Birkenhead Merseyslde L41 6BR (GB) 



(54) Maintaining document state history 

(57) Methods and apparatus embodying techniques 
useful in systems for creating and modifying docu- 
ments. A state history of a document for storing docu- 
ment states is maintained; and, whenever an interesting 
operation has occurred, the state of the document is 
automatically captured as it exists after the operation. 
The captured state is added to the state history. In 
another aspect, the techniques identify for a user on a 
display device a set of states that the document has 
been in by operation of the system; and enable the user 
to designate any arbitrary one of the identified states for 
further operations The techniques may provide both lin- 
ear and non-linear history 
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Description 

BACKGROUND OF THE INVENTION 

[0001 ] The present invention relates to electronic sys- 
tems operable under program control to create and edit 
electronic documents. 

[0002] A conventional feature of computer program 
applications that create and edit documents is an undo 
command. Applications written for the Microsoft® Win- 
dows 95 operating system often use Ctrl-Z as a key- 
board shortcut for the undo command. 
[0003] One mechanism for implementing undo in 
applications is based on a command object that knows 
how to do, undo, and redo an operation. This is 
described, for example, in Gamma et al., Design Pat- 
terns, Addison-Wesley Publishing Co., © 1995, pages 
233 to 242. Multiple undo may then be implemented by 
keeping a command history. Gamma notes on page 239 
that such an implementation has a strong potential for 
error accumulation and recommends using the 
"memento" pattern as part of the command object. 
Some applications provide a user with a list of the most 
recent actions and allow the user to select one of the 
actions, thereby undoing the selected action and all 
actions above it (that is, all more recent actions) in the 
list. 

[0004] A related feature available in some applications 
allows a user to save a document that is being edited 
and later revert to the saved version, thereby discarding 
intervening changes to the document. 
[0005] The conventional behavior of an undo com- 
mand restores the document to the state it had before 
the operation being undone was done. 

SUMMARY OF THE INVENTION 

[0006] In general, in one aspect, the invention pro- 
vides methods and apparatus embodying techniques 
for performing operations on documents having states 
The techniques include performing operations to main- 
tain in a memory a state history of a document for stor- 
ing document states: and, whenever an interesting 
operation has occurred, automatically capture the state 
of the document as it exists after the operation and add- 
ing the captured state to the state history. 
[0007] In general, in another aspect, the techniques 
include operations to maintain a first history of interest- 
ing operations and a second history of all operations 
requested by a user, the second history but not the first 
history including operations global to the state of the 
application. 

[0008] In general, in another aspect, the techniques 
include operations to receive from the user a sequence 
of commands to change the document; change the doc- 
ument state in response to each command; add the 
changed document state to a state history maintained in 
a computer-readable memory device each time the doc- 



ument state is changed; for each document state added 
to the state history, add a corresponding entry to a his- 
tory list displayed to the user on a computer-controlled 
display device operated as part of a graphical user inter- 
5 face; and, in response to a user action stepping back- 
ward to an item in the history list, update the document 
to have the corresponding document state saved in the 
state history. 

[0009] In general, in another aspect, the techniques 
io include operations to keep a history list; go back to a 
previous state in the history list; select a future state 
from the history list, being a state created after the pre- 
vious state, as a source of data for an operation; and 
perform the operation with the future data on the previ- 
J5 ous state. 

[0010] In general, in another aspect, the techniques 
include operations to keep a history of document states 
created by a user; enable the user to discard any of the 
history; and enable the user to step backward and for- 
20 ward through the history and thereby to alter the state of 
the document to be any of the document states in the 
history. 

[0011] In general, in another aspect, the techniques 
include operations to keep a history of document states 

2s created automatically whenever a user command to the 
application changes the state of a document; enable the 
user to discard any user-selected set of the document 
states in the history; and enable the user to designate 
any one of the document states in the history and 

30 thereby install the designated state as the current state 
of the document. 

[0012] In general, in another aspect, the techniques 
include operations to create and modify a document; 
identify for a user on a display device a set of states that 
35 the document has been in by operation of the applica- 
tion; and enable the user to designate any arbitrary one 
of the identified states. 

[001 3] Particular implementations of the invention will 
have one or more of the following advantages. Use of a 

40 state history supports a quick and efficient multiple 
undo operation, particularly in the context of an applica- 
tion like a image editing application whose operations 
often act on an entire document. It enables a user to 
access prior states of a document randomly. It enables 

45 a prior state of a document to be turned into its own doc- 
ument. It provides a way to implement multiple undo 
efficiently white avoiding operation sequence depend- 
encies. A large history of commands on a document 
may be navigated quickly and without increasing time 

so cost for navigating over many commands. It somewhat 
simplifies treating multiple contiguous user commands - 
- such as multiple commands moving the same object in 
an image -- as a single command for undo purposes. 
Where revisions to one document may be made using 

55 data from another document, the invention provides a 
multiple undo feature without risk of inter-document 
dependencies. 

[0014] Further advantages include the following In a 
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non-linear mode of operation, a user may edit a docu- 
ment starting from an earlier-captured document state 
without losing later-captured states. For example, using 
a digital painting application, a user may apply a series 
of filters to an image, then go back to the original image 
state, and then selectively paint in the effects of those 
filters using a history paintbrush tool. Use of a smooth- 
moving control interface element allows a user easily to 
scan through a document's history while viewing the 
history states as they are selected by the control, creat- 
ing a movie-like presentation of at least a portion of the 
document creation and editing process. 
[001 5] Other features and advantages of the invention 
will become apparent from the following description and 
from the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0016] 

FIG. 1 is a schematic block diagram of a computer 
system running an application program in accord- 
ance with the invention. 

FIG. 2 shows a history palette user interface ele- 
ment of an implementation of the invention. 
FIG. 3 is a flowchart of steps performed by an appli- 
cation operating in accordance with the invention. 
FIG. 4 is a flowchart elaborating on FIG. 3. 
FIG. 5 is a flowchart elaborating on FIG. 4. 

DETAILED DESCRIPTION 

[0017] As shown in FIG. 1, a conventional program- 
mable computer system 100 has at least a processor 
component 1 14 capable of executing computer program 
instructions, a memory component 1 12 for storing pro- 
grams and data, and a user interface device or devices 
1 16 by which a person - a user - may interact with pro- 
grams running on the system 100 These and other 
components are connected to interact with each other 
by one or more buses 118. The memory component will 
generally include a volatile random access memory 
(RAM), a non-volatile read-only memory (ROM), and 
one or more large disk drives. The system may run one 
or more programs. Application 120 is a computer pro- 
gram designed for a particular task, and, as is typical, it 
acts on a central depository called a document, whose 
content a user creates and edits. Some applications, as 
illustrated, may allow a user to have more than one doc- 
ument, such as documents 130 and 1 40, open at a time, 
and allow the user to select one or the other of them as 
the active document that is the focus or target of editing 
and other document-directed actions. 
[0018] A document is typically displayed in a rectan- 
gular region of the display screen called a document 
window. A spreadsheet application displays a spread- 
sheet document designed to look and act like a 2- 
dimensional table. A word-processing application dis- 



32108A2 4 

plays a document designed to look like a sheet of paper. 
An image processing application displays a document 
designed to look like a photograph or a drawing. 
[0019] As is conventional, application 120 is illustrated 
5 as having program instructions 122 that may be exe- 
cuted to operated on data 124. Application 120 is pro- 
grammed to implement a state history feature, and so 
associates with each open document 130 and 140 a 
corresponding state history 132 and 142 and a corre- 
w sponding undo buffer 134 and 144, respectively. The 
application also has an undo buffer 126 for the applica- 
tion itself. In an alternative implementation, the applica- 
tion undo buffer is the only undo buffer and the 
commands stored there include a reference to the rele- 
ts vant document, if any. If the application undo buffer con- 
tains a command to undo, then all of the document undo 
buffers should be empty, to maintain intuitive operation 
of the undo-redo feature. 

[0020] As shown in FIG. 2, an application implement- 
20 ing a history list provides, as part of a graphical user 
interface, a floating history palette 200 that a user may 
show or hide with menu commands or other user inter- 
face commands. Pertinent aspects of the operation of 
the application will now be described in terms of the 
25 information made available on the history palette 200 
and the operations a user may perform using the history 
palette. 

[0021 ] When a document is opened or newly created, 
the application generates a snapshot of the document 

30 and updates the snapshot or upper region 204 of the 
palette with a thumbnail image representing the snap- 
shot and the name of the snapshot, which the user may 
edit. The lower portion 206 of the palette is initialized 
with an item named "Open" or "New", for the initial doc- 

35 ument state, so that the user will be able to step back- 
ward from his or her first state-changing operation. (This 
may be viewed as characterizing opening and creating 
a document as "interesting" operations, as described 
below.) The history palette 200 is associated with a par- 

40 ticular document. If the user has two documents 130 
and 140 (FIG. 1) open, each will have a separate history 
palette, and the history palette shown when one of the 
documents is active will reflect the state history 132 or 
142, respectively, of the corresponding document 130 

« or 140. 

[0022] Viewing parameters, such as a viewing magni- 
fication, which affect how the application displays the 
document but do not affect the actual document data, 
may be considered interesting in a particular implemen- 

50 tation. For example, a viewing parameter that applies to 
all views of a document may well be treated as interest- 
ing and considered part of the state of the document; 
whereas if the document can be viewed in multiple open 
windows with a viewing parameter that can be set differ- 

55 ently for each view, the parameter would more naturally 
not be considered interesting or part of the document 
state. 

[0023] The state of the document is recorded in the 
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state history after the user makes a change to the doc- 
ument that changes the state of the document. The 
application may - implicitly or expressly -- categorize 
commands into those that change the document state 
(the "interesting" ones) and those that do not. As an 
example, some commands, such as successive, con- 
secutive commands moving a single object, may be 
interesting only in the aggregate, when they have been 
collapsed into a single move-object command. As 
another example, some commands are global, such as 
a change to a palette or to preferences, in that they 
change the state of the application, and are not made to 
a particular document. 

[0024] When a document state is recorded, it is 
appended as an item at the end of the history list portion 
206. Each item has an icon and a brief textual descrip- 
tion of corresponding command. The icon shows the 
tool used to perform the command or, for menu and dia- 
log commands, it is a menu or dialog icon. Both the 
upper portion 204 and the lower portion 206 are specific 
to the current document and will change when a differ- 
ent document is made active. 
[0025] The user may grab a small control 208 on the 
left side of the palette and drag it up and down to cause 
states of the document to be displayed, according to the 
position of the control. Doing so causes the current 
state - the one being displayed as a result of the drag- 
ging action - to be highlighted and those after it to be 
dimmed. In FIG. 2, the state corresponding to the sec- 
ond history list item, "Selection", is highlighted, and 
those following it are dimmed. Other user interface ges- 
tures, such as clicking on an item, will have the same 
effect. If the user then begins to alter the document, all 
items in the history list 206 below the selected item will 
be deleted. (An alternative and more powerful mode of 
operation - non-linear history mode - will be described 
later.) 

[0026] The left most column of the floating palette has 
buttons 210 that may be selected to establish the corre- 
sponding state - whether a state in the state history or 
a snapshot - as the state that will be used as a source 
state by history-based tools. Such a selection is 
recorded on the palette with an icon to mark the 
selected state. As illustrated, a history paintbrush icon 
is used to indicate that the corresponding state will be 
used when a history paintbrush tool is used on the 
active document. If no more than one state may be 
selected as a source for history-based tools, the buttons 
210 will behave like radio buttons, in that selecting one 
state will deselect any other selected state. As will be 
described, both earlier and later document states (that 
is, both items above and below the current state item in 
the history list) may be selected as a history source. 
[0027] The history paintbrush tool may be selected 
from a tool palette like any of the other tools that the 
user may select to perform operations on a document 
In operation, the history paintbrush operates to paint on 
a target document input from the source. In an image 



application, the input may be pixel data, blending 
modes, clipping paths, or any other data that is part of 
the source document state. The semantics of the tool 
may ~ but need not - require the source to be a state 

5 (present, past, or future) of the target document; alter- 
natively, the semantics may permit a tool to use as a 
source a state derived from a document entirely inde- 
pendent from the target document. 
[0028] The history palette 200 may also be used as a 

w source for a drag and drop command. When the user 
grabs an item on the palette and drags it to another doc- 
ument, the source state (the document state corre- 
sponding to the drag item) will be applied to the targeted 
document. The semantics of applying a state to a docu- 

15 ment are application specific, and may depend on the 
nature of the source state. (For example, it may be a 
complete document state, such as is found in the state 
history, or it may be a partial state, such as is captured 
when a snapshot is taken of a single layer of an image 

20 document.) In the semantics of one implementation, to 
apply a complete document state appends the source 
state to the history list and installs it as the current state 
of the target document. If the source is a partial state 
such as an image layer, it could be added as a layer to 

25 the target document. Alternatively, even a complete 
source image document could be flattened to a single 
layer and added to the target document. 
[0029] The history palette also has a pop-up menu 
202. This menu provides commands to step forward 

30 through a history list, to step backward through a history 
list, to create a new snapshot, to delete a history or 
snapshot item, to clear the history list 206 (and corre- 
sponding state history); to create a new document from 
a saved document state, and to set options for the his- 

35 tory features 

[0030] The step forward and step backward com- 
mands enable the user to walk backward and forward 
through the current history list 206, as was described 
earlier in reference to control 208 

w [0031 ] A user may create a snapshot of any point in 
the document's history either by using the new-snap- 
shot command in the pop-up menu 202 or by using the 
command button 214 in the palette. For example, a user 
may select a history state by moving control 208 to the 

45 corresponding list item and then selecting snapshot but- 
ton 21 4, which will bring up a dialog window for the user 
to name the snapshot and optionally set snapshot con- 
trol options. In particular, the user may choose to snap- 
shot a full document from the state, a composition of all 

so the layers of the document state, or the current layer as 
it exists in the selected document state. An item for the 
newly created snapshot will be appended to the upper 
list 204 of the palette. 

[0032] As has been mentioned, the features associ- 
55 ated with the history palette 200 operate differently in 
non-linear history mode from what has been described 
above in two important respects. In non linear history 
mode, deleting an item from the history list 206 does not 



4 



7 



EP 0 932 108 A2 



cause the items below the deleted item to be deleted. 
Because the later document states are complete in 
themselves, earlier ones may be deleted with no 
adverse effect. Also, in non-linear history mode, a user 
may step backward to an earlier document state, begin 5 
working from there, and not cause the later document 
states to be deleted. Rather, the new document states 
are added to the end of the history list, which as a result 
will show two branches of state history. 
[0033] Operation of the history palette records some, ro 
but not all, changes made by a user. Changes that are 
local to the document will be recorded, while changes 
that are global to the application will not be recorded. A 
global change, like changing a setting for a tool, will not 
cause a document state to be saved in a state history or is 
an item to be added to the history list, because the doc- 
ument state has not been changed and therefore any 
previously captured state is still the state of the docu- 
ment. On the other hand, a local change, like creating or 
modifying a document path, layer, or channel, will cause 20 
a document state to be saved and an item to be added 
to the history list. 

[0034] In conjunction with the history palette, it 
remains useful to have a conventional undo-redo fea- 
ture that allows a user to undo and redo the most recent 25 
command without regard to whether it was local or glo- 
bal. This is accomplished by saving an undo item for the 
most recent user command in a document-specific 
buffer and applying the undo menu command or its key- 
board shortcut as a toggle to undo and redo the opera- 30 
tion. 

[0035] FIG. 3 and FIG. 4, along with the accompany- 
ing description, are intended to explain the operation 
and use of the state history feature so that they may be 
readily understood, and so details of implementation 35 
and optimization are omitted. A practical implementa- 
tion of the pertinent command dispatch and processing 
functions would be expected to combine and reorganize 
the illustrated steps and implement them in accordance 
with well-understood software engineering techniques. 10 
[0036] As shown in FIG. 3, the operation of an imple- 
mentation of the state history feature may be seen to 
begin when a user enters a command (step 302). A 
command is a request made by the user to the applica- 
tion, through a graphical user interface, for example, to 45 
change the state of the application or the state of the 
active document. The application performs the corre- 
sponding action (step 304, which will be elaborated in 
reference to FIG. 4). If the action is one categorized as 
not affecting the state of a document (the no branch of so 
decision step 306), the state history and history list are 
unaffected. Otherwise, if the action of the command was 
performed with the document in the state of the tempo- 
rally most recent entry in the history list, which corre- 
sponds to the temporally most recent state in the state 55 
history, the state of the document after the action is 
stored in the state history and the history list on the his- 
tory palette is updated (the yes branch of step 308, and 



steps 312, 314, and 320). On the no branch of step 308, 
if non-linear history mode is in effect, nothing is dis- 
carded from the history list or the state history merely 
because an interesting command has been entered (the 
yes branch of step 310). In linear history mode (the no 
branch of step 310), the history list items below the cur- 
rent state item and the corresponding states in the state 
history are discarded, other than any item selected as a 
source for history-based tools, such as the history paint- 
brush (see description of buttons 210, above). 
[0037] If the maximum size of the history list or state 
history had been reached, the top (earliest) item from 
the history list -- excluding any item selected as a 
source for history-based tools - is discarded, along with 
its corresponding document state in the state history, 
before the new document state is stored (the no branch 
of step 312 and step 318) 

[0038] To produce a practical implementation, it is 
advantageous to store document states in a form that 
allows a great deal of sharing between saved states, to 
keep to a minimum the amount of memory consumed in 
storing redundant information, and the processor 
resources consumed in writing and reading it. A data 
representation suitable for this purpose is described in 
commonly-owned U.S. patent application serial no 
08/702,941 to Hamburg for "Shared Tile Image Repre- 
sentations" filed August 26, 1996 
[0039] Referring to FIG. 4, aspects of the perform 
action step (step 30, FIG. 3) pertinent to an implemen- 
tation of a state history feature will not be described. If 
the user's command is not an undo or a redo, that is, not 
the Ctrl-Z toggle, the command is stored in an undo 
buffer associated with the active document, such as 
buffers 134 and 144 of FIG. 1 (the yes branch of deci- 
sion step 41 0 and step 412) If the command is an undo 
or a redo, the undo or redo operation of the command in 
the undo buffer is executed (step 412). It should be 
noted that the history-related commands, and in partic- 
ular changes to the history list and the state history, can 
be subject to the conventional undo and redo (step 
412) The provides an advantageous and elegant user 
interface that allows, for example, a user to toggle 
between two document states previously selected from 
anywhere in the state history with a single repeated key- 
stroke. 

[0040] Returning to FIG. 4, the next pertinent step 
considers whether the command relates to the history 
list or the history palette. If not, the command is per- 
formed (step 418) and operation continues (step 420) 
with decision step 306 (FIG. 3). Otherwise, the com- 
mand is one that uses the history list (the yes branch of 
decision step 416), and the processing of it will now be 
described. 

[0041] If the command navigates the history list ~ for 
example, a step-backward command, step-forward 
command, or list item selection command - the docu- 
ment state corresponding to selected item is installed as 
the current state of the active document (steps 430 and 
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432). 

[0042] If the command designates a source for his- 
tory-based commands - for example, a command 
selecting a column 210 button to designate a source for 
the history paintbrush - the targeted history state is 
linked as the source document to the tools that can take 
a source document state as an input (steps 434 and 
436). The history-based commands that may be imple- 
mented in a painting application include the history 
paintbrush, which paints from the source state onto the 
active document; a fill-from-history command that per- 
forms a fill operation on the active document with input 
from the source state; and an eraser that erases the 
active document to the source state. As has been men- 
tioned, the source state may be either earlier or later 
than the current state, enabling a user to paint from 
either the future or the past. 

[0043] If the command deletes a history list item (the 
yes branch of step 438), the behavior depends on 
whether the operating mode is linear history mode or 
non-linear history mode and where in the history list the 
selected item falls (step 444). As shown in FIG. 5, in 
nonlinear history mode, only the selected item and its 
document state are deleted (the yes branch of decision 
step 502 and step 504). Otherwise, the position of the 
selected item with respect to the current state of the 
document is considered (step 506). If the selected item 
is below (was created later than) the current state or the 
same as the current state, both the selected item and its 
state, and any later items (below the selected item in the 
history list) and their states are also deleted (step 510). 
If the selected item is above (was created earlier than) 
the current state, both the selected item and its state, 
and any earlier items (above the selected item in the 
history list) and their states are also deleted (step 508). 
Where a range of states is deleted (steps 508 and 51 0), 
a special check is made not to delete any item selected 
as a source for history-based tools. 
[0044] Returning to FIG. 4, if the command creates a 
new document (the yes branch of decision step 446), 
the initial state of the new document is copied from the 
document state in the state history corresponding to the 
selected history list item (step 448). 
[0045] A clear history command may also be imple- 
mented, with which a user may delete all non-snapshot 
states other than the current state and any history paint- 
brush source state. 

[0046] A state history feature is particularly advanta- 
geous in an image manipulation application, such as the 
Photoshop® program available from Adobe Systems 
Incorporated of San Jose, California In this application, 
each document is, as is typical, a single-page image 
that is generally viewed as a whole by the user in the 
process of creation and editing. This application has 
many powerful painting and selection tools, supports 
multiple layers, each with multiple channels, special 
effects filters, and lighting effects. In this sophisticated 
environment, the state history feature with its non-linear 



operating mode is particularly advantageous, in that it 
permits a user to step backward and forward through a 
set of states, picking up effects from a future state and 
applying them to a past state to create a new branch of 

5 development of an image. 

[0047] The invention may be implemented in digital 
electronic circuitry, or in computer hardware, firmware, 
software, or in combinations of them. Apparatus of the 
invention may be implemented in a computer program 

io product tangibly embodied in a machine-readable stor- 
age device for execution by a programmable processor; 
and method steps of the invention may be performed by 
a programmable processor executing a program of 
instructions to perform functions of the invention by 

15 operating on input data and generating output. The 
invention may advantageously be implemented in one 
or more computer programs that are executable on a 
programmable system including at least one program- 
mable processor coupled to receive data and instruc- 

20 tions from, and to transmit data and instructions to, a 
data storage system, at least one input device, and at 
least one output device. Each computer program may 
be implemented in a high-level procedural or object-ori- 
ented programming language, or in assembly or 

25 machine language if desired; and in any case, the lan- 
guage may be a compiled or interpreted language. Suit- 
able processors include, by way of example, both 
general and special purpose microprocessors. Gener- 
ally, a processor will receive instructions and data from 

30 a read-only memory and/or a random access memory. 
Storage devices suitable for tangibly embodying compu- 
ter program instructions and data include all forms of 
nonvolatile memory, including by way of example semi- 
conductor memory devices, such as EPROM, EEP- 

35 ROM, and flash memory devices; magnetic disks such 
as internal hard disks and removable disks; magneto- 
optical disks; and CD-ROM disks. Any of the foregoing 
may be supplemented by, or incorporated in, specially- 
designed ASICs (application-specific integrated cir- 

« cuits). 

[0048] Other embodiments are within the scope of the 
following claims. For example, the order of performing 
steps of the invention may be changed by those skilled 
in the art and still achieve desirable results. Forms of 

45 user interface other that a list on a palette to show state 
history may be used, such as a stack of items or a pull- 
down or pop-up menu, and that revision branches cre- 
ated in non-linear history mode may be shown as a tree 
or other representation of an directed acyclic graph. To 

so satisfy user preferences for how an undo-redo feature or 
a state history feature should behave in a particular 
application, the application may be implemented to treat 
selected commands or operations as not interesting 
and therefore not captured in an undo buffer or a state 

55 history, to conform the design of the user interface of the 
application to user expectations. The user interface 
aspects of the invention may be embodied using meth- 
ods of preserving document state information other 
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than storing an entire state, for example, by storing state 
differences or even command histories 



1. A computer-implemented method of interacting 
with a user editing a document in a computer pro- 
gram application, the document having a document 
state, the method comprising: 

receiving from the user a sequence of com- 
mands to change the document; 
changing the document state in response to 
each command; 

adding the changed document state to a state rs 
history maintained in a computer-readable 
memory device each time the document state 
is changed; 

for each document state added to the state his- 
tory, adding a corresponding entry to a history 20 
list displayed to the user on a computer-control- 
led display device operated as part of a graphi- 
cal user interface; and 

in response to a user action stepping backward 
to an item in the history list, updating the docu- 25 
ment to have the corresponding document 
state saved in the state history 

2. The method of claim 1 , wherein: 

30 

the state history and the history list are limited 
to storing a preset number of items and excess 
items are scrolled off the top of the list as new 
items are added. 

35 

3. The method of claim 1 , wherein: 

the state history is stored in a region of memory 
and the oldest document states in the state his- 
tory are discarded when free space in the 40 
region runs low. 

4. The method of claim 3 wherein: 

the oldest document states are found and dis- 45 
carded by a memory management process. 

5. The method of claim 1 , wherein: 

a command to change the document that so 
comes after a step-backward command to a 
selected item in the history list causes the 
items after the selected item to be deleted from 
the history list and the corresponding docu- 
ment states to be deleted from the state history, ss 

6. The method of claim 1 , wherein: 



08 A2 12 

a command to change the document that 
comes after a step-backward command to a 
selected item in the history list does not cause 
the items after the selected item to be deleted 
from the history list and adds a new item to the 
end of the history list and a new document 
state to the state history. 

7. The method of claim 1 , further comprising: 

enabling a user interface gesture on the history 
list to create a new document from a document 
state from the state history. 

8. A method implemented in a computer program 
application operable to create and edit a document, 
comprising: 

keeping a history list; 

going back to a previous state in the history list; 
selecting a future state from the history list, 
being a state created after the previous state, 
as a source of data for an operation; and 
performing the operation with the future data 
on the previous state. 

9. A method implemented in a computer program 
application operable to create and edit a document, 
comprising: 

keeping a history of document states created 
by a user; 

enabling the user to discard any of the history; 
and 

enabling the user to step backward and forward 
through the history and thereby to alter the 
state of the document to be any of the docu- 
ment states in the history 

10. A method implemented in a document-processing 
computer program application, the method com- 
prising: 

keeping a history of document states created 
automatically whenever a user command to the 
application changes the state of a document; 
enabling the user to discard any user-selected 
set of the document states in the history; and 
enabling the user to designate any one of the 
document states in the history and thereby 
install the designated state as the current state 
of the document. 

11. The method of claim 1 0 further comprising: 

saving the history when the document is closed 
on a long-term storage medium, whereby the 
history may be restored when the document is 
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later opened and across invocations of the 
application. 

1 2. The method of claim 1 1 , wherein: 

the saved history resides in the document with 
final document data. 

1 3. The method of claim 1 1 , wherein: 

the saved history resides in a long-term data 
repository independent of the original docu- 
ment. 

14. A method enabling a user to control operation of a 
computer program application for creating and 
modifying a document, the method comprising: 
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21. The method of claim 20, wherein the list elements 
are ordered by the time the corresponding states 
were created. 

5 22. The method of claim 17, wherein the designation 
and installation are performed in response to a sin- 
gle command. 

23. The method of claim 1 7, wherein the set of states is 
io displayed in an order, the method further compris- 
ing: 

enabling the user to make a gesture on a user 
interface indicating a sequence of displayed 
15 state identifiers and responding to the gesture 

by displaying the document in the states indi- 
cated as the gesture is made. 



identifying for the user on a display device a set 24. The method of claim 1 7, further comprising: 

of states that the document has been in by 20 

operation of the application; and enabling the user to modify the document state 

enabling the user to designate any arbitrary after the installing step; and 

one of the identified states. adding the document state resulting from the 
modification to the set of states identified on 

15. The method of claim 14, further comprising: 25 the display device. 



displaying the document in a user interface 
window, the document being a digital image, 

16. The method of claim 15, wherein the digital image 
has a plurality of layers, each of the plurality of lay- 
ers having a plurality of channels, the method fur- 
ther comprising: 

displaying user-interface elements for applying 
filters to the digital image. 

17. The method of claim 14, further comprising: 

installing the designated state as the current 
state of the document in response to a user 
command. 

18. The method of claim 14, further comprising: 

providing the user an editing tool having the 
designated state as a document state operand. 

19. The method of claim 14, further comprising: 

providing the user an delete tool for deleting 
the designated state from the set of states. 

20. The method of claim 14, wherein: 

the set of states is identified by displaying a 
scrollable list of elements each identifying one 
of the states in the set. 



25. The method of claim 23, wherein the set of states is 
displayed in order of creation of the states in the 
set. 

30 

26. The method of claim 23, wherein the document is a 
digital image. 

27. The method of claim 17, further comprising: 

35 

providing a step-backward command and a 
step-forward command for the user to execute 
to navigate the set of states; and 
providing a separate undo and redo command 
40 for the user to undo and redo commands 

entered by the user. 

28. The method of claim 18, further comprising: 

45 providing a step-backward command and a 

step-forward command for the user to execute 
to navigate the set of states; and 
providing a separate undo and redo command 
for the user to undo and redo commands 

50 entered by the user. 

29. A method implemented in a computer program 
application performing operations on documents 
having states, the method comprising: 

55 

maintaining in a memory a state history of a 
document for storing document states; and 
whenever an interesting operation has 
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occurred, automatically capturing the state of 
the document as it exists after the operation 
and adding the captured state to the state his- 
tory. 

30. The method of claim 29, wherein the memory com- 
prises a disk file. 

31. The method of claim 29, wherein: 

the state history includes states of the docu- 
ment and the order in which the stored states 
were automatically added to the state history; 
the state history is displayed to a user as a list 
of document states shown in their stored order; 
an operation is classified as an interesting 
operation if it changes the state of the docu- 
ment; 

a state is added to the state history only if the 
operation creating the state is classified as an 
interesting operation and not otherwise; 
performing a step-backward operation by 
installing as the current state of the document a 
state stored in the state history, whereby all 
step-backward operations place the document 
in a state that occurred immediately after an 
interesting operation; and 
performing a step-forward operation by install- 
ing as the current state of the document a state 
stored in the state history, whereby all step-for- 
ward operations place the document in a state 
that occurred immediately after an interesting 
operation. 

32. The method of claim 31 , wherein: 

the list of document states displayed to the user 
comprises a list of items, each item represent- 
ing a state of the document that existed after an 
interesting operation and that can be recovered 
with a step-backward operation in the applica- 
tion; and 

the list of document states displayed to the user 
comprises a list of items, each item represent- 
ing a state of the document that existed after an 
interesting operation and that can be recovered 
directly by selecting the item. 

33. The method of claim 32, wherein: 

the application is digital graphics program 
operable to create and revise images in digital 
form; 

the application provides a tool operable under 
user control to obtain source material from any 
state in the state history and apply it to a cur- 
rent state of the document: and 
the images are raster images. 
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34. The method of claim 32, wherein: 

the application enables a user to select any 
item in the displayed list of items and cause the 
5 application to create a new document having 

the document state corresponding to the 
selected item. 

35. The method of claim 32, wherein: 

10 

each of the captured states in the state history 
maintains the state data in essentially its origi- 
nal form, whereby the captured state data is 
suitable for immediate use in other operations. 

15 

36. A method for enabling a user to undo revisions 
made to a document, the method comprising: 

maintaining a first history of interesting opera- 
20 tions and a second history of all operations 

requested by a user, the second history but not 
the first history including operations global to 
the state of the application. 

25 37. The method of claim 36, further comprising: 

providing to the user a first undo command 
function that operates with reference to the first 
history and a second undo command function 
30 that operates with reference to the second his- 

tory. 

38. Apparatus comprising a computer-readable stor- 
age medium tangibly embodying program instruc- 

35 tions defining a computer program application for 
performing operations on documents having states, 
the program comprising instructions operable for 
causing a programmable processor to: 

40 maintain in a memory a state history of a docu- 

ment for storing document states: and 
whenever an interesting operation has 
occurred, automatically capture the state of the 
document as it exists after the operation and 

45 adding the captured state to the state history. 

39. Apparatus comprising a computer-readable stor- 
age medium tangibly embodying program instruc- 
tions for use by a user of a program to undo 

so revisions made to a document, the apparatus com- 
prising instructions operable for causing a program- 
mable processor to: 

maintain a first history of interesting operations 
55 and a second history of all operations 

requested by a user, the second history but not 
the first history including operations global to 
the state of the application. 
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40. Apparatus comprising a computer-readable stor- 
age medium tangibly embodying program instruc- 
tions for interacting with a user editing a document 
in a computer program application, the document 
having a document state, the apparatus comprising 
instructions operable for causing a programmable 
processor to: 

receive from the user a sequence of com- 
mands to change the document; 
change the document state in response to 
each command; 

add the changed document state to a state his- 
tory maintained in a computer-readable mem- 
ory device each time the document state is 
changed; 

for each document state added to the state his- 
tory, add a corresponding entry to a history list 
displayed to the user on a computer-controlled 
display device operated as part of a graphical 



in response to a user action stepping backward 
to an item in the history list, update the docu- 
ment to have the corresponding document 
state saved in the state history. 2s 

41. A computer program, residing on a computer-read- 
able medium, comprising instructions for causing a 
computer to: 

30 

keep a history list; 

go back to a previous state in the history list; 
select a future state from the history list, being 
a state created after the previous state, as a 
source of data for an operation : and 35 
perform the operation with the future data on 
the previous state. 

42. A computer program, residing on a computer-read- 
able medium, comprising instructions for causing a *o 
computer to: 

keep a history of document states created by a 
user; 

enable the user to discard any of the history; 4s 
and 

enable the user to step backward and forward 
through the history and thereby to alter the 
state of the document to be any of the docu- 
ment states in the history. so 

43. A computer program, residing on a computer-read- 
able medium, comprising instructions for causing a 
computer to: 

55 

keep a history of document states created 
automatically whenever a user command to the 
application changes the state of a document; 



enable the user to discard any user-selected 
set of the document states in the history; and 
enable the user to designate any one of the 
document states in the history and thereby 
install the designated state as the current state 
of the document. 

f. A computer program, residing on a computer-read- 
able medium, comprising instructions for causing a 
computer to: 

create and modify a document; 
identify for a user on a display device a set of 
states that the document has been in by opera- 
tion of the application; and 
enable the user to designate any arbitrary one 
of the identified states. 
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